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Abstract 

Research in materials evaluation has been an important focus in ELT since the 1980s. The objective of the present study 
is to evaluate the general attributes of the textbooks and to evaluate the learning-teaching content. In this study, 944 
male and female English teachers (Year 1 to Year 6 & Form 1 to Form 5) evaluated the English books using a valid and 
reliable checklist. In terms of general attributes and learning-teaching content of the textbooks, the results showed that 
Year 1 to Year 6 teachers reported that the current textbooks are ‘highly useful’ to the students, whereas Form 1 to 
Form 5 teachers contended that the school books are only ‘moderately useful’. The findings of this study can be useful 
for curricula designers and Ministry of Education as a reference for improving or modifying the textbooks. 
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1. Introduction 

Materials evaluation is quite a new phenomenon in the field of language teaching. Tomlinson (2001, p.66) defines 
materials as “anything which can be used to facilitate the learning of a language.” ELT materials, in particular, 
(textbooks) play a very significant role in many language classrooms but in recent years there has been a lot of 
discussion throughout the ELT profession on the actual role of materials in teaching English as a Second/Foreign 
Language (Litz, 2005). The choice of language teaching materials can determine the quality of learning-teaching. 
Hence, particular and serious attention must be paid to evaluate such materials based on valid and reliable instruments 
(Mukundan, Nimehchisalem &Hajimohammadi, 2011). 

1.1 Statement of the problem 

In an attempt to examine the effectiveness of textbooks used in the classroom, TESL researchers in Malaysia conducted 
studies on the evaluation of textbooks currently used in secondary schools (Ghazali, 2008; Mukundan, 2003, 2007). 
These studies were conducted to examine the suitability of the Malaysian school English language textbooks, and 
whether or not learners would get the desirable benefit from the content of these books in order to achieve the 
educational objectives. They all reported that the textbooks that they evaluated needed some improvements and they 
recommended evaluating the textbooks using different instruments and larger sample sizes before making sure their 
findings can be generalized. 

So, even though the vetting had been done by the Textbook Division of the Ministry of Education (MOE), it is 
necessary for teachers to evaluate the textbooks because in their teaching-learning contexts, a particular textbook may 
not be able to contribute positively to students’ development in the acquisition of the English Language. Indeed, 
sometimes, a textbook may lead to learners’ failure in acquiring the language and in worst cases, it may contain serious 
pedagogical flaws and other shortcomings (Litz, 2005; Tomlinson, 2008) 

With regard to this problem of failure or success of a textbook, it is useful to conduct ELT textbook evaluation so as to 
ensure that ELT textbooks can effectively facilitate the achievement of teaching objectives (Mukundan, 2007). Often it 
is the only resource for both teachers and learners in some learning-teaching contexts. It is, therefore, the researchers’ 
aims to evaluate the English textbooks so as to ensure that they are suitable for the learners and capable of helping 
teachers to realize the pedagogical goals of the new curriculum. 

1.2 Research questions 

1. How did the teachers evaluate the general attributes of the textbooks? 

2. How did the teachers evaluate the learning-teaching content? 
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1.3 Significance of the Study 

The findings of the study are expected to offer some suggestions to help the English language teachers with the use of 
the textbook. The evaluation results can help to enhance the effectiveness of the use of the textbook by helping teachers 
to understand what areas of the textbook need adaptation, or to what extent use of other possible teaching materials is 
necessary. 

2. Literature Review 

It seems that there can be very little teaching done without the textbook. Teachers seem to believe that it saves them 
time and financial resources as DIY (Do-IT-Yourself, or teacher-developed materials) are costly and require greater use 
of teacher-time. As Hutchinson and Torres (1994 cited in Litz, 2005) state: 

The textbook is an almost universal element of [English language] teaching. Millions of copies are sold every 
year, and numerous aid projects have been set up to produce them in [various] countries...No teaching¬ 
learning situation, it seems, is complete until it has its relevant textbook, (p. 315) 

Yet, various attitudes exist toward textbooks. For instance, Tomlinson (2001) shares the attitudes into two groups: 
proponents and opponents. The former group contends that textbooks are the most convenient form of presenting 
materials because they offer consistency, systematicity, cohesion, continuation, and progression, whereas the latter 
contend that textbooks are inevitably superficial and reductionist in their coverage and are not able to satisfy the diverse 
and broad needs of all their users. Therefore, it is implied that the first group views textbooks as useful for general 
purposes while the second group considers the shortcomings of textbooks as context-related. Despite entire 
disagreements, it is widely agreed that textbooks are of great value in the process of teaching and learning 
(Cunningsworth, 1995; Haycroft, 1998; O’Neil, 1982; Sheldon, 1988). 

Sheldon (1988) states that there are numerous reasons for the evaluation of textbooks. Among these reasons, he 
proposes that the selection of an English language teaching textbook often demonstrates an important administrative 
and educational decision which involves considerable amount of professional, financial, or even political investment. In 
addition, Ellis (1997) proposes that material evaluation could be conducted at three stages: 

1) ‘predictive’ or ‘pre-use’ evaluation that is designed to examine the future or potential performance of a 
textbook; 

2) ‘in-use’ evaluation designed to examine material that is currently being used; and 

3) ‘retrospective’ or ‘post-use’ (reflective) evaluation of a textbook that is concerned with the evaluation of 
textbooks after they have been used in a specific institution or situation. 

This study is an‘‘in-use” evaluation of a number of textbooks using an established checklist. 

2.1 The Role of Textbooks in the EFL/ESL Classroom 

A textbook is referred to as a published book specially designed to aid language learners to improve their linguistic and 
communicative abilities (Sheldon, 1987). In addition to being learning tools, textbooks are also used as supporting 
teaching materials (O’Neil, 1982, & Ur, 1996). The student’s book usually comes with other materials such as a 
workbook, a teacher’s book or even additional multimodal texts for reference as a textbook package (Masuhara& 
Tomlinson, 2008). They are “designed to give cohesion to the language teaching and learning process by providing 
direction support and specific language-based activities aimed at offering classroom practice for students” (Mares, 
2003) and promote effective and swift learning of the language (Cunningsworth, 1995). 

2.2 The Need for Textbook Evaluation 

The ever increasing number of textbooks on the market makes formulating the right choice in textbooks difficult 
(Cunningsworth, 1995, Green 1926). Textbook selection can have a massive impact on the teaching and learning 
process (Cunningsworth, 1995; Harmer, 1991; McGrath, 2002). In that sense, the quality of a textbook might be so 
important that it can determine the success or failure of an ELT course (Green 1926, Mukundan 2007). However, 
textbooks are often purchased without careful analyses (Green, 1926, McGrath 2002). Frequently, textbook selection is 
not based on its intrinsic pedagogical value, but of the perceived prestige of the author and or the publisher (Green 
1926, McGrath 2002), or skillful marketing by the publishers (McGrath, 2002). 

A number of studies have suggested that most current global, ELT textbooks are developed for commercial purposes 
and are not based on principles of language acquisition and development recommended by scholars and educators 
(Tomlinson, 2003, 2008 & 2010). Financial success has become the primary goal of textbook publishing (Sheldon 
1988, Litz 2005, Tomlinson, 2003). 

“Textbooks, like any other book that publishers print, are pieces of merchandise; the ultimate objective of their 
production is [for] commercial success” (Dendrinosm 1992:35). Instead of contributing positively to student’s 
development in the acquisition of the English language, many textbooks are in fact leading to learner’s failure in 
acquiring the language and in the worst case, contain serious pedagogical flaws and practical shortcomings (Litz 2005, 
Tomlinson 2008:3). 

Tomlinson (2008) mentions two causes for learning failure. The first cause of failure is possibly motivated by the need 
of commercial success, which is, publishers would have to produce books based on the public demand. Textbook 
writing as a result is moulded according to the liking of teachers, parents and administrators with a heavy focus on the 
teaching of linguistic items instead of creating opportunities for students to acquire the language through usage 
(Tomlinson, 2008). Also, teachers tend to choose textbooks that are designed to allow for minimal preparation for their 
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classes (Dendrinos, 1992,Tomlinson 2008,& 2010). The second cause of failure is that instead of focusing on how 
learners could actually benefit from using the textbook, textbook writers rely on their intuition and produce materials 
what they think would work best for their intended users (Tomlinson, 2008:7). They are biased towards perceived rather 
than actual needs of learners (Tomlinson, 2003). Though the textbooks written by professional writers are usually of 
good quality in terms of organization, packaging and design, they tend to be lacking in qualities of being creative and 
imaginative(Tomlinson, 2003). Litz (2005) also suggested that some more recent scholars in the area of ELT materials 
development expressed concerns for the cultural content of textbooks which are “inherently socially and culturally/ 
biased” and help to preserve a form of “gendered” English (Banegas, 2011, Litz, 2005: 6). 

In view of the above, it is, therefore, very important for us to conduct ESL/EFL textbook evaluation so as to ensure ELT 
textbooks can effectively facilitate the attainment of our teaching objectives, and at the same time, be economically 
viable to teachers and students. Wrong choice of textbooks would be likely to negatively affect both teaching and 
learning. Financial resources would also be wasted (Mukundan, 2007; Sheldon, 1988). 

2.4 Past Research on ESL Textbooks Evaluation Studies 

Mukundan (2003) highlighted that in order to avoid problems in evaluating a textbook, the evaluation has to be 
systematic and effective. The point is, of course, that a global list of criteria can never really apply in most local 
environments, without considerable modification. 

There are a lot of studies around the world that evaluated the textbooks used in the school systems. These studies 
consider textbook from different points of view with different instruments. 

Chao (2009) retrospectively evaluated the English textbook used in a chosen local college in Taiwan based on 
Intercultural Competence Model (ICC). This textbook was written by a local publisher. As the findings showed, the 
content in the textbook did not seem to help English learners develop intercultural abilities. The results showed also that 
although the textbook was colourfully filled with photos and pictures, there was no explanation of its meaning, function, 
location, and source of each photo. As for teacher’s manual, the design of this teacher’s manual reflected the traditional 
need of Taiwanese English teachers and learners in language classrooms. 

Nemati (2009) evaluated English Pre-University textbook of Karnataka State in India in terms of the merits and 
demerits of the textbooks, and in specific vocabulary teaching strategies. The teachers in government and non¬ 
government schools seem to be fully satisfied with the textbook. According to the results, the teachers believed that the 
textbook has the main criteria that are fundamental and necessary for any textbook such as the presentation of the four 
main language skills. The evaluated textbook was acceptable in terms of the topics that make the students familiar with 
different aspects of their culture as well as with customs and culture of English countries and other countries. The book 
was clearly organized and graded from easy to difficult. The book taught principles of paragraph writing. It also did not 
neglect speaking and includes dialogues and role play or communicative activities. As for the vocabulary analysis, 
(Nemati, 2009) suggests that it is better to change the sequence of presenting the text so the texts with more frequent 
vocabulary and as a result easier ones come first and texts with rare and much more difficult vocabularies appear 
towards the end of the book. 

Kirkgoz (2009) evaluated three English textbooks which were used in grade 4 in the primary schools in Turkey. A great 
balance was observed between the responses of the teachers and students. The findings from the questionnaire and the 
interview were also consistent. The participants appreciated the textbooks in their layout with the attractive design and 
well-produced illustrations. They had interesting and well-presented vocabulary, clear and understandable instructions, 
containing authenticity in examples, activities, topic and subject content. They promoted a balanced development of the 
four language skills (reading, listening, writing and speaking). 

Aroo (2012) evaluated the suitability of the newly introduced textbook namely, English Year 2. Findings revealed that, 
overall, the teachers considered the textbook highly suitable for the learners. In Aroo’s study, two teachers evaluated the 
textbook. On average, the first teacher rated the textbook 2.90 (upon 4.00) that was slightly lower than the second 
teacher’s rating (M = 3.10). However, in reference to the score interpretation guide provided by Mukundan and 
Nimehchisalem (2011), both scores fall under the same level of ‘high suitability’. In Aroo’s study, with respect to the 
overall suitability of the textbook and its ability to fulfil the needs of the learners, both teachers were dissatisfied with 
the speaking, reading and writing activities although they had been designed to fit the objectives of the syllabus. 
Writing activities and exercises were too limited in the textbook. The results also indicated that new words were not 
repeated in the subsequent parts of the book. As for grammar, it was not explicitly presented in this textbook because of 
the low age of the learners. Grammar is introduced from Year Three onwards. In terms of components like content, 
syllabus, pronunciation, layout, durability, and printing quality the book would fulfil the requirements of a good 
textbook. 

Mukundan and Roslim(2009) present a corpus-based investigation on English preposition presented in three English 
language textbooks used by lower secondary schools in Malaysia. The findings showed that there is a difference 
between the words in the textbook corpus and the BNC (British National Corpus) in terms of frequency order of certain 
prepositions. The findings can guide teachers in deciding how best to supplement the text with activities that will give 
learners exposure to target grammar item that is not sufficiently presented in the textbook. 

Mukundan, Leong and Nimehchisalem (2011) analysed the distribution patterns of the articles in the five Malaysia 
Secondary English language textbooks. They analysed the content of the articles and found out there is lack of variety 
in exercises on articles. 
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The objectives of the present study were to evaluate the general attributes of the textbooks and to evaluate the learning¬ 
teaching content. To meet these objectives quantitative method, descriptive in nature, was used. 

3.1 The evaluators 

A total number of 944 evaluators took part in this study. The evaluators of this study were male (18%) and female 
(92%) English teachers of Year 1 to Year 6 and Form 1 to Form 5 from urban and rural schools in Melaka State, 
Malaysia. Table 1 provides further information on the specific number of the evaluators from each grade who 
participated in this study. 


Ta ble 1, Number of evaluators from each grade 


Grades 

Number 

Grades 

Number 

Year 1 

115 

Form 1 

57 

Year 2 

112 

Form 2 

55 

Year 3 

108 

Form 3 

54 

Year 4 

112 

Form 4 

56 

Year 5 

105 

Form 5 

56 

Year 6 

114 



Total 

666 

Total 

278 


3.2 Data Collection Method 

3.2.1 The checklist 

In this research, a checklist proposed by Mukundan and Nimchisalem (2011) (Appendix 1) was adopted by the 
researchers. The checklist is called the English Language Teaching Textbook Evaluation Checklist (ELT-TEC), a user- 
friendly instrument that has been validated and tested for its reliability. It was developed by a review of the literature 
(Mukundan & Ahour, 2010; Mukundan, Flajimohammadi, &Nimehchisalem , 2011) and was refined through qualitative 
(Mukundan, Nimehchisalem, & Flajimohammadi, 2011; Nimehchisalem & Mukundan, In Press, a) and quantitative 
(Mukundan & Nimchisalem, 2011) methods. 

It contains two main categories: i) The textbook general attributes ii) Textbook learning Content 

There are five major components under general attributes which are (a) Syllabus and curriculum, (b) Methodology, (c) 
Suitability to learners, (d) Physical and Utilitarian Attributes, (e) Efficient outlay of supplementary materials. 

There are major components under learning-teaching contents which are (a) General content, (b) Listening, (c) 
Speaking, (d) Reading, (e) Writing, (f) Vocabulary, (g) Grammar, (h) Pronunciation, and (i) Exercise. 

The rating system is based on a 5-point scale; 0 = NEVER TRUE; 1 = RARELY TRUE; 2 = SOMETIMES TRUE; 3 = 
OFTEN TRUE; 4 = ALWAYS TRUE; in case the item is not applicable, the evaluator may use the option as NA= NOT 
APPLICABLE. In order to interpret the date easily, there is a table that provides information and guide to interpret the 
findings. 

This checklist is user friendly, cost effective, systematic, easy to understand, and ensures that all elements that are 
deemed to be important in textbook evaluation. 

3.2.2 The Validity of the Instrument 

The English language Teaching Textbook Evaluation Checklist (ELT-TEC) has been tested for its validity by 
Nimehchisalem and Mukundan (In Press, b). In their study, a group of evaluators (n=82) who used the checklist to 
assess a textbook, indicated high to very high (72-95%) levels of satisfaction with the ELT-TEC. The instrument has 
also proved to be economical. On average, it took the evaluators 9.5 minutes to assess a textbook using the ELT-TEC. 
This was considerably shorter (almost three times) as compared with the time spent using the Skierso (1991) Checklist 
(28.5 minutes). The checklist has been tested for its concurrent validity of its results with those of other well 
established instruments (Skierso, 1991) and strong correlations^ = 0.75) have been achieved (Mukundan& 
Nimehchisalem, 2012). 

3.2.3 The Reliability of the Instrument 

The checklist has been tested for its reliability (Mukundan & Nimchisalem, 2012). Inter-rater reliability tests have 
shown acceptable reliability coefficients (r=.962). For the present study, the internal reliability was calculated. 


Table 2, Reliability Statistics 


Cronbach's 

Alpha 

N of Items 

.962 

39 


Table 2 presents the Cronbach reliability statistics for ELT-TEC. The relaibailty is considerably high (r=,962). 
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This section discusses the results of the study. The results have been presented following the order of the research 
questions. 

4.1 General attributes in Yearl-Year6 & Forml-Form 5 textbooks 

The first research question was “how did the teachers evaluate the general attributes of the textbooks?” Table 3 shows 
the results for general attributes in Year 1 to Year 6 textbooks. 

Table 3.General attributes in Year 1-Year 6 textbooks 


Grade 

Mean 

SD 

Year 1 

2.92 

0.53 

Year 2 

2.87 

0.62 

Year 3 

2.92 

0.53 

Year 4 

2.94 

0.48 

Year 5 

2.96 

0.55 

Year 6 

2.88 

0.60 


Key: 0-0.8 = Negligible usefulness, 0.81-1.6 = Low usefulness, 1.61-2.80 = Moderate usefulness, 2.81-3.6 = High 

usefulness, 3.61-4 = Very high usefulness 

According to the table, the mean scores for Year 1- Year 6 showed that all the teachers agreed that the current books 
that are being used in the schools are highly useful. The highest mean score (M=2.96, SD= 0.55) was reported for Year 
5 textbook, whereas the lowest mean score (M=2.87, SD= 0.62) was reported for Year 2 textbook. Evidently, there is 
not a considerable difference among the mean scores of the five textbooks. The findings of this part are in congruence 
with Aroo (2012) and Ping (2011) that used the older version of the ELT-TEC to evaluate Year 2 and Year 1 textbooks. 
They found that Year 2 and Year 1 teachers had agreed on high usefulness of the textbooks. 

Table 4 shows how the teachers evaluated Form 1 to Form 5 textbooks regarding their general attributes. Based on the 
teachers’ evaluation, the currents books are moderately useful for the secondary students. 


Table 4.General attributes in Form 1-Form 5 textbooks 


Grade 

Mean 

SD 

Form 1 

2.52 

0.59 

Form 2 

2.54 

0.59 

Form 3 

2.47 

0.58 

Form 4 

2.29 

0.61 

Form 5 

2.34 

0.55 


The highest mean score (M=2.54, SD= 0.59) was reported for Form 2 textbook, whereas the lowest mean score 
(M=2.29, SD= 0.61) was reported Form 4 textbook. The findings of secondary level (Form 1-Form 5) were unlike the 
primary (Year 1-Year 6) level. 

4.2 Learning-teaching content in Yearl-Year6 & Form l-Form5 textbooks 

The second research question was “how did the teachers evaluate the learning-teaching content of the textbooks?” Table 
5 shows the results for learning-teaching content in Year 1 to Year 6 textbooks. 


T able 5. Learning-teaching content Year 1-Year 6 textbooks 


Grade 

Mean 

SD 

Year 1 

2.95 

0.50 

Year 2 

2.94 

0.66 

Year 3 

2.86 

0.53 

Year 4 

2.86 

0.51 

Year 5 

2.87 

0.61 

Year 6 

2.84 

0.65 


Based on the teachers’ evaluations, the current Year 1- Year 6 books are highly useful. The highest mean score 
(M=2.95, SD= 0.50) was obtained for Year 1 textbook, whereas the lowest mean score (M=2.84, SD= 0.65) was 
reported for Year 6 textbook. Overall, there was not a remarkable difference among the mean scores assigned for the 
five textbooks. These findings are consistent with Aroo (2012) and Ping’s (2011). Their evaluation of Year 2 and Year 
1 textbooks indicated high usefulness of both textbooks. 

Table 6 shows the results for learning-teaching content in Form 1 to Form 5. As can be seen, teachers in these grades 
reported that the current books are moderately useful for secondary students. 
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Table 6. Learning-teaching content in Form 1-Form 5 textbooks 


Grade 

Mean 

SD 

Form 1 

2.59 

0.60 

Form 2 

2.61 

0.60 

Fotm 3 

2.61 

0.49 

Form 4 

2.38 

0.64 

Fotm 5 

2.32 

0.61 


The highest mean scores (M=2.61, SD= 0.60 & M=2.61, SD= 0.49) were reported for Form 2 and Form 3 textbooks, 
respectively. In contrast, the lowest mean score (M=2.32, SD= 0.61) was reported for Form 5 textbook. The findings 
show that primary level (Year 1-Year 6) textbooks are of higher usefulness compared with secondary level (Form 1- 
Form 5) textbooks. 

5. Conclusion & Implication 

Textbook evaluation is considered very substantial because the information, which is collected, can be used for making 
decisions about the future of the textbooks (Sultana, Khan, Ali, & Rehman, 2007). In order to adjust and improve a 
curriculum, textbooks and the materials used in the ELT program need to be improved. This is not possible unless 
teachers who are involved directly in the ELT program evaluate them on the basis of some established criteria provided 
by checklists. 

In terms of general attributes and learning-teaching content of the textbooks, the teachers reported that the current Year 
1 to Year 6 textbooks are highly beneficial to the students, whereas Form 1 to Form 5 teachers contended that the 
school books are moderately useful. 

Generally, although there were two contradictory views on the usefulness of the Malaysian school English textbooks 
reported by primary and secondary school teachers, the findings of this study can be used as a reference for improving 
or modifying the textbooks. In addition the Ministry of Education can use these findings to seek strengths and 
weaknesses of the textbooks and update school English learning-teaching materials along with considering their 
suitability to the learners. Further studies can be carried out by observing the way in which the textbooks are used in the 
language classrooms. 

This study emphasizes the role of retrospective evaluation of textbooks. It is very important to evaluate the usefulness 
of any textbook while it is being used. The results of such an evaluation can shed light on the probable weaknesses of 
the textbook that can lead to important adaptations. 
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English language teaching textbook evaluation checklist 


Instructions 

Read the items in the checklist and in the column opposite the items indicate the level to which they agree with each 
statement by marking 0 to 4: 

0 = Never true 3 = Often true 

1 = Rarely true 4 = Always true 

2 = Sometimes true NA= Not Applicable 

NB: There may be one or more sections that you may not find applicable to your teaching context. In such cases, check 
the box in the ‘NA’ (or, Not Applicable) column and disregard the section in evaluating the textbook. 


NA 

□ 

I. General attributes 

A. The book in relation to syllabus and curriculum 

1. It matches the specifications of the syllabus. 

2. Overall, the book has a nice feel. 

® ® © © © 

® ® © © © 

NA 

□ 

B. Methodology 

3. The activities can be exploited fully. 

4. Activities can work well in most classroom situations. 

® ® © © © 

® ® © © © 

NA 

□ 

C. Suitability to learners 

5. It is compatible with the background knowledge and level of students. 

6. It addresses learning targets. 

® ® © © © 

® ® © © © 

NA 

□ 

D. Physical and utilitarian attributes 

7. It is appropriately priced. 

8. Its layout is attractive. 

9. It indicates efficient use of text and visuals. 

® ® © © © 

® ® © © © 

NA 

□ 

E. Efficient layout of supplementary materials 

10. The book is supported by suitable materials, like a workbook, audio, 
or multimedia. 

11. The book is supported by other materials like review and test units. 

12. There is a useful teacher’s guide to aid the teacher. 

® ® © © © 

® ® © © © 

® ® © © © 

NA 

□ 

II. Learning-teaching content 

F. General content 

13. Tasks move from simple to complex. 

14. Tasks are varied. 

15. Tasks support teaching objectives. 

16. The language in the textbook is natural and real. 

17. The material is fairly recent. 

® ® © © © 

® ® © © © 

® ® © © © 

® ® © © © 

® ® © © © 

NA 

□ 

G. Listening 

18. The book has appropriate listening tasks with well-defined goals. 

19. Tasks are authentic or close to real language situations. 

20. Various listening contexts such as formal vs. informal contexts are 
considered. 

® ® © © © 

® ® © © © 

® ® © © © 

NA 

□ 

H. Speaking 

21. Activities are developed to initiate meaningful communication. 

22. Individual, pair and group work are given equal emphasis. 

® ® © © © 

® ® © © © 

NA 

□ 

I. Reading 

23. Length is appropriate. 

24. Difficulty level is appropriate. 

25. Texts are interesting. 

® ® © © © 

® ® © © © 

® ® © © © 
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NA 

□ 

J. Writing 

26. Tasks have achievable goals and take into consideration learner 
capabilities. 

27. Tasks are interesting. 

® © © ® © 

® ® © ® © 

NA 

□ 

K. Vocabulary 

28. The load (number of new words in each lesson) is appropriate to the 
level of students. 

29. There is a good distribution (simple to complex) of vocabulary load 
across chapters and the whole book. 

30. New words are sufficiently repeated and recycled across the book. 

31. Words are contextualized. 

® ® © ® © 

® ® © ® © 

® ® © ® © 

® ® © ® © 

NA 

□ 

L. Grammar 

32. Grammar is contextualized. 

33. Grammar items are repeated throughout the book. 

® ® © ® © 

® ® © ® © 

NA 

□ 

M. Pronunciation 

34. Tasks are useful. 

35. Tasks are interesting. 

® © © ® © 

NA 

□ 

N. Exercises 

36. They have clear instructions. 

37. They are adequate. 

38. They are interesting. 

39. They help students with mixed abilities. 

® ® © ® © 

® ® © ® © 

® © © ® © 

® ® © ® © 


Table: Scores Interpretation Guide 


Level 

Range 

Interpretation 

0 

0.00-0.80 

Negligible usefulness 

1 

0.81-1.60 

Low usefulness 

2 

1.61-2.80 

Moderate usefulness 

3 

2.81-3.60 

High usefulness 

4 

3.61-4.00 

Very high usefulness 





